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1.0  Summary 


The  research  project  utilized  a  combination  of  theory  and  experimentation  to  advance  both 
the  design  methods  and  delivered  functionality  of  Multi-Agent  systems  in  the  context  of 
military-relevant  problem  domains.  To  date,  potential  users  of  agent  technology  have  not  had  a 
disciplined  means  for  designing  an  agent-based  solution  to  address  a  given  problem  and 
assessing  the  value  the  generated  solution  with  regard  to  the  needs  of  that  problem.  The  design 
and  verification  methods  resulting  from  this  research  provided  (i)  a  classification  and  metrics 
framework  for  comparing  agent-based  solutions/systems  and  their  respective  capabilities,  (ii) 
tools  and  techniques  for  designing  and  evaluating  architectures  for  agent-based  systems,  and  (iii) 
tools  and  techniques  for  verifying  that  a  given  solution  delivers  intended  behavior  and  is  faithful 
to  the  architecture  specifications.  The  research  contributed  advances  in  the  theory  and 
application  of  specific  capabilities  that  enable  a  system  of  agents  acting  as  distributed  decision¬ 
makers  to  (i)  organize  the  decision-making  and  infonnation  sharing  connectivity  to  maximize 
system  performance,  (ii)  assess  the  trustworthiness  of  information  by  determining  the  level  of 
information  uncertainty  and  reliability  of  information  source  and  (iii)  plan  and  coordinate 
efficiently  by  exchanging  their  preferences  for  actions  under  varying  organizations  and 
situations. 
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2.0  Introduction 


This  research  effort  aimed  to  transform  Agent  Design  from  a  “black  art”  to  a  science.  Prior 
Multi-Agent  System  (MAS)  development  has  focused  on  the  advancement  of  “Core 
Competencies”  giving  an  agent  the  ability  to:  proactively  plan  to  achieve  goals  or  react  to  events 
[45,  54],  model  its  environment  [14],  sense  and  act  on  its  environment  [58],  communicate  with 
other  agents  [53],  coordinate  with  other  agents  [39,  51],  and  resolve  conflicts  [1]. 

MAS  are  systems  whose  BEHAVIOR  is  driven  by  those  of  its  constituent  agents  (software 
components)  which  are,  in  turn,  affected  by  their  constituent  Core  Competencies  and  the 
techniques  implementing  those  Core  Competencies  (Figure  1).  Note:  Agents  may  form  one  or 
more  societies/organizations  within  the  “system”  where  the  “system”  boundaries  may  range  from 
the  Internet  to  a  military  command-and-control  system. 


Figure  1:  Core  Competencies  influence  agent  behavior  and  thus  system  behavior 
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The  research  team  envisions  MAS  design  as  a  two-step  process: 

1)  Determination  of  the  Core  Competencies  (  behaviors)  a  respective  agent  should  perform  given  a 
set  of  criteria  mandated  by  the  application  problem  domain. 

2)  Determination  of  how  these  selected  Core  Competencies  will  be  implemented  (  selection  of  Core 
Competency  techniques  such  as  contract  nets  for  coordination). 


In  current  practice,  the  design  process  does  not  necessarily  follow  the  order  mentioned 
above.  A  designer  may  make  implementation  decisions  first  (e.g.  KQML  [53]  for 
communication  language,  negotiation  or  specifically  Contract  Nets  [61]  for  coordination,  Partial 
Global  Planning  [40]  for  planning)  where  the  decisions  regarding  the  selection  of  the  agent’s 
Core  Competencies  are  implicit.  Of  course,  integration  of  the  respective  Core  Competency 
techniques  (implementations)  is  left  to  a  skilled,  well-informed  agent  designer  and  in  some  cases 
may  be  impossible.  Many  (most)  MAS  are  developed  in  compliance  with  a  specific  agent  design 
[38,  52,  57,  62]  where  the  Core  Competencies  are  pre-determined  and  technique  choices  are  also 
pre-detennined  but  may  evolve  in  sophistication.  Empirical-based,  application-specific  analysis 
has  been  the  norm  for  MAS  evaluation  at  one  or  multiple  levels: 

1)  Behaviors  exhibited  by  Core  Competency  techniques  such  as  the  performance  of  a  particular 
coordination  protocol, 

2)  Agent  behaviors  resulting  from  its  constituent  selected  techniques,  and 

3)  Overall  system  behavior  emerging  from  the  collective  and  interacting  agent  behaviors  (Figure  1). 
This  typical  approach  to  MAS  design,  development,  and  analysis  severely  limits  the  ability  of 
MAS  designers  to  perfonn  bottom-up  analysis;  involving  investigations  of  agent-level  and 
system-level  behavior  as  a  function  of  selected  Core  Competency  techniques,  and  top-down 
analysis;  determining  the  effect  of  given  agent-  and  system-level  performance  criteria  on  the 
selection  of  Core  Competency  techniques.  This  current  practice  exists  for  a  number  of  reasons: 

1)  Designers  do  not  have  any  formal  models  to  describe  MAS  behaviors,  behavioral  interactions 
between  these  Core  Competencies,  and  the  variants  of  behaviors  or  interactions  as  a  function  of 
the  different  combinations  of  Core  Competencies,  numbers  of  agents,  etc. 

2)  Designers  do  not  have  a  library  of  possible  Core  Competency  techniques  or  a  formal  models  and 
analytic  methods  to  correlate  potential  designs  to  desired  behaviors. 

3)  Designers  do  not  have  analytical  methods  or  tools  to  assist  them  in  evaluating  the  complexity  of 
both  their  designs,  (i.e.  the  multitude  of  behaviors,  interactions)  and  variants. 

The  typical  ad-hoc  agent  design  and  analysis  methods  result  in  “stove-pipe”  MAS  solutions 
and  research  communities  focusing  on  particular  Core  Competencies  and  techniques,  as  well  as 
difficulty  in  migrating  techniques  across  MAS  designs  or  leveraging  lessons  learned.  Promotion 
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of  a  specific  Core  Competency  technique  often  ignores  the  question:  “What  is  the  best  set  of 
behaviors  and  corresponding  implementations  for  this  particular  application?”  This  research 
worked  to  change  this  current  scenario.  We  believe  that  the  scientific  fonnulation  of  multi¬ 
agent  design  and  analysis  theory  could  be  pursued  using  two  distinctly  different  methodologies: 

1)  Deployment  of  a  case  study  research  effort  to  evaluate  a  wide  range  of  existing  MAS  designs, 
formally  specify  those  designs  then  evaluate  the  designs  according  to  some  defined  metrics  (e.g. 
performance)  to  develop  a  repository  of  lessons  learned  -  an  approach  to  document  the  as-is  but 
not  leam  the  1 st  principles  of  agent  design  and  engineering  to  discover  why  behaviors  exist  and 
how  new  behaviors,  dynamics  or  optimization  paths  can  be  discovered,  OR 

2)  Specify  and  analyze  the  underlying  MAS  behaviors  and  the  dependencies  between  those 
behaviors  independent  of  decisions  regarding  the  techniques  to  implement  those  behaviors  then 
evaluate  constraints  imposed  on  those  behaviors  as  a  result  of  design  decisions. 

We  pursued  the  second  one.  The  intent  of  this  research  was  to  analyze  and  develop  formal 
models  and  analysis  of  respective  MAS  behaviors  (at  all  three  levels  in  Figure  1)  and  the 
interaction  dependencies  between  those  behaviors  to  provide  designers  with  a  set  of  1st  principles 
by  which  they  can  select  Core  Competencies  and  assign  techniques  to  realize  the  desired  agent 
behaviors.  This  research  first  developed  the  models,  analytical  methods  and  tools  giving 
designers  the  ability  to  construct,  analyze,  and  discover  functional/behavioral  MAS  architectures. 

The  proposed  research  launched  from  the  observation:  “Design  decisions  are  intricately 
related  to  objective  performance  criteria  and  available,  underlying  Core  Competencies  as  well  as 
the  techniques  deployed  to  deliver  those  Core  Competencies.”  The  evaluation  approach 
correlated  design-based  constraints  on  parameters  associated  with  system-,  agent-  and  Core 
Competency-  level  behaviors  to  analyze  the  resulting  dynamics. 

As  an  outcome  to  this  funded  research  project,  the  work  delivered  in  the  following  advances 
to  the  scientific  community: 

•  Advancement  #1 :  Theory  and  tools  to  design  and  verify  competency-based  MAS 
architectures 

•  Advancement  #2:  Core  Competency  Advances  and  Experimentation  as  implemented  in 
the  Sensible  Agent  architecture  developed  at  UT-Austin 

•  Advancement  #3:  Application-related  Demonstrations  and  Experimentations  to  evaluate 
competency-based  MAS  designs  as  well  as  specific  core  competencies. 
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3.0  Methods,  Assumptions  and  Procedures 


The  proposed  technical  approach  delivered  rigor  to  the  design  and  engineering  of  Multi- 
Agent  Systems  (MAS)  by  providing  (1)  mathematical  models  of  MAS  capabilities,  functionality 
and  operational  structure,  (2)  fonnals  methods  to  analyze  and  optimize  MAS  dynamics,  and  (3) 
an  automated  tool  (DACAT)  to  leverage  the  mathematical  models,  analytic  techniques  and 
design  optimization  guidelines  to  evaluate  design  decisions  (constraints)  with  regard  to  what 
capabilities  and  topologies  exist  in  the  functional/behavioral  MAS  architecture  and  how 
(implementation  techniques  of  core  competencies)  the  MAS  system  architecture  is  realized. 

Multi-Agent  System  (MAS)  development  has  focused  on  the  advancement  of  “Core 
Competencies.”  We  view  the  set  CCAi  of  Core  Competencies  of  agent  A,  as  comprised  of  8- 
tuples  involving  the  following  basic  parameters:  (1)  Planning  proactively  or  deliberatively,  P,  (2) 
Reacting,  R,  (3)  Modeling  self,  others  and/or  environment,  M,  (4)  Sensing,  S,  (5)  Actuation,  A, 
(6)  Coordination,  Coord,  (7)  Communication,  Comm,  and  (8)  Conflict  Resolution,  CR.  For 
course,  the  issue  of  modeling  scale  (level  of  detail)  of  Core  Competencies  is  a  research  issue.  We 
postulate  that  Agent  Capabilities  =  T(Core  Competencies  at  a  given  time)=  T(CCAi,  t). 

Therefore,  at  the  highest  level,  the  capabilities  of  agent  Ao  are  dictated  by  the  Core 
Competencies  that  A0  is  endowed  with.  Roughly,  we  may  say  that  the  modeling  issue  is  as 
follows:  given  a  family  of  agents  Aj,  for  i=l,...,n,  each  agent  4,  performs,  at  each  instant  of  time, 
t,  some  set  of  tasks  related  to  its  Core  Competencies,  7)  =T(Ait  t),  which  require  some  set  of 
resources  that  must  be  either  provided  to  or  owned  by  the  agent  Aj.  For  simplicity,  we  start  the 
discussion  of  our  research  approach  by  considering  four  primary  elements: 

•  Task  Space:  For  a  single  agent  A,  at  time  t,  the  Task  Space,  denoted  by  T(CC,u,t),  depends  on 
the  structure  of  the  Core  Competencies  CCai  assigned  to  the  agent.  For  a  given  collection  of 
agents,  the  Task  Space,  T,  is  the  union  of  the  Task  Spaces  of  the  individual  agents,  and  hence 
it  spans  the  functional  behaviors  of  all  the  agents  in  the  system.  When  Core  Competencies 
are  decomposed  into  tasks  and  those  task  decomposed  further  into  subtasks  and  so  on,  the 
Task  Scale  refers  to  the  level  of  this  decomposition. 

•  Resource  Spaces:  The  Resource  Space  is  composed  of  the  resources  provided  to  an  agent 
through  inputs  to  tasks,  IR(Tj ,  t)  (e.g.  sensed  data  or  data  received  through  communication) 
and  the  resources  a  respective  agent  owns  at  particular  time,  OR(r,  Aiy  Tj,  t).  The  parameter  r 
represents  the  weights  that  are  placed  on  the  owned  resource  to  indicate  partial  ownership  in 
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the  case  of  shared  resources  between  agents  to  perform  task  Tj.  The  Resource  Scales  refer  to 
the  level  of  association  of  the  resource  space. 

•  Agent  Space:  The  Agent  space,  A (t)  is  the  collection  of  agents  in  the  system  at  each 
instance  of  time,  t.  The  Agent  Scales  within  this  space  represent  the  agent  organizations 
formed  to  solve  goals.  In  other  words,  corresponding  to  goal  G;- ,  AS(G„t)  denotes  the 
collection  and  organizational  structure  of  agents  that  have  teamed  up  to  achieve  this  goal. 

•  Connectivity  between  spaces:  The  Connectivity  is  simply  (but  not  simple)  an  explicit 
representation  of  the  inter-dependencies  between  the  Task,  Resource  and  Agent  spaces  and 
scales  within  those  spaces.  Specifically,  the  connectivity  C  between  spaces  addresses  the 
level  of  complexity  introduced  by  the  dependencies  among  tasks  for  the  8  different  Core 
Competencies  CCkAi ,  k=l,...,8  within  a  single  A, agent,  which  is  denoted  by 

C(T (AjCCiAut), ...  ,T (AuCCsAut)).  Similarly,  in  the  case  where  the  dependencies  are  between 
tasks  and  resources  within  a  single  agent  this  connectivity  relation  is  denoted  by 
C (T(Ai,CCiAi,t),...,  T(Ai,CCsAi,t),  IR(Tj ,t),OR(r,  Ait  Tj,  tj).  Also,  these  relational 
dependencies  change  when  the  number  of  agents  increases  and/or  the  organizational 
relationships  between  agents  change.  In  addition,  connectivity  may  be  random  and  may 
occur  within  a  Core  Competency,  within  an  agent  or  among  agents.  Connectivity  may  be 
dictated  by  closeness  of  resources  or  tasks  in  their  natural  topology.  For  instance  connectivity 
may  be  a  function  of  physical  distance  or  any  other  notion  (resource  sharing  capabilities,  task 
similarity,  etc).  Connectivity  is  the  link  that  holds  the  previous  spaces  together  and  a  very 
fundamental  focus  of  our  research. 


The  research  effort  will  deliver  both  semantic,  ontological  representations  of  the  spaces  as 
well  as  mathematical  representations.  The  exact  representation  of  the  spaces  may  vary  and  will 
be  a  modeling  choice  during  the  research  effort.  For  example,  mathematical  representations  of 
resources  and  tasks  may  be  represented  as  sets,  probability  densities,  or  vectors  of  sets.  These 
spaces  exhibit  some  very  complex  dependencies.  Thus,  the  research  approach  is  carefully  laid 
out  to  mitigate  this  complexity  by  starting  with  problems  exhibiting  reduced  dependencies 
between  spaces  and  building  up  from  there.  The  modeling  effort  can  be  summarized  in  the  three 
phases  described  below. 

•  Phase  1  focused  on  modeling  the  constituent  tasks  associated  with  each  Core  Competency, 
the  resources  associated  with  those  tasks,  and  the  task  connectivity  resulting  from  resource 
dependencies  among  tasks.  A  single  agent  system  is  considered  in  this  phase,  reducing 
significantly  the  complexity  inherent  to  a  multi-agent  space. 

•  Phase  2  introduced  a  homogeneous  multi-agent  space.  By  homogeneous,  we  mean  that  all 
agents  are  assigned  the  same  Core  Competencies,  and  consequently  the  same  Core 
Competency  tasks  (Task  space)  and  the  same  set  of  resources  to  perform  those  tasks 
(Resource  space).  Connectivity  among  agents  can  be  fully  explored. 

•  Phase  3  introduced  the  concept  of  heterogeneous  agents  where  agents  are  composed  of 
various  combinations  of  Core  Competencies. 
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Electrical  circuit  designers  are  guided  by  a  set  of  first  principles  dictated  by  the  known 
underlying  behaviors  of  current,  voltage,  power,  etc.  These  behaviors  have  dependencies 
(power  =  current*voltage).  Circuit  designers  currently  benefit  from  a  wide  range  of  tools  to 
model  designs  (transistor  designs)  such  that  the  design  reflects  the  desired  current,  voltage,  and 
power  behaviors.  Additionally,  these  designers  have  tools  to  analyze  the  dynamic  characteristics 
of  their  designs  (e.g.  ability  of  the  transistor  to  deliver  power  given  input  current)  as  a  function  of 
design  parameters  or  constraints  on  behaviors  (e.g.  resistance  within  the  transistor);  thus, 
allowing  designers  to  specify  “optimal”  design  specifications.  These  tools  are  possible  because 
the  behaviors,  behavioral  dependencies  and  behavioral  dynamics  are  well  known.  The 
Designer’s  Agent  Creation  and  Analysis  Toolkit  (DACAT)  and  Tracer  tool  are  intended  to 
provide  for  MAS  designers  what  circuit  designers  now  enjoy  -  understanding  of  the  first 
principles  of  MAS  behaviors  and  the  ability  to  design  MAS  to  optimize  those  core  competency 
behaviors. 
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4.0  Results  and  Discussions 

The  results  and  discussion  offered  by  this  research  project  are  defined  below  and  organized 
by  overarching  research  advances. 

•  Advancement  #1 :  Theory  and  tools  to  design  and  verify  competency-based  MAS 
architectures 

•  Advancement  #2:  Core  Competency  Advances  and  Experimentation  as  implemented  in 
the  Sensible  Agent  architecture  developed  at  UT-Austin 

•  Advancement  #3:  Application-related  Demonstrations  and  Experimentations  to  evaluate 
competency-based  MAS  designs  as  well  as  specific  core  competencies. 
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4.1  Advancement  #1:  Theory  and  tools  to  design  and  verify 
competency-based  MAS  architectures 

The  research  project  advanced  the  theory  and  tools  to  design  and  verify  competency-based 
MAS  architectures.  Tools  were  developed  and  leveraged  to  office  MAS  designer’s  the  ability  to 
formally  specify  and  evaluate  their  Multi- Agent  Systems.  Specific  contributions  in  this  area  are 
listed  below: 


•  Developed  the  Designer ’s  Agent  Creation  and  Analysis  Toolkit  (DACAT)  for  use  by 
the  agent-based  system  designer  to  specify  an  agent  Reference  Architecture  (RA). 

The  RA  specifies  agent  functionality  in  a  domain-  and  technology-  independent 
manner  to  foster  reuse,  promote  separation  of  concerns,  accommodate  multiple 
potential  agent  technologies,  and  provide  a  foundation  for  comparing  agent-based 
implementations.  Functionality  described  in  the  agent  RA  is  specified  in  tenns  of 
UT-Austin  Core  Competencies,  which  are  allocated  to  architecture  classes  in  the 
DACAT  design  process.  The  class  structure  is  evaluated  using  coupling  and  cohesion 
metrics,  which  are  good  predictors  of  overall  system  qualities  such  as  reusability  and 
maintainability.  The  resulting  RA  is  exported  and  used  by  ACET  and  ICET 
described  below. 

•  Developed  explanation-based  methods  to  verify  consistency  between  the 
interpretation  of  an  agent-based  solution ’s  execution  and  the  user ’s  comprehension 
of  the  agents  ’  behaviors.  Accomplishments  include  building  an  Agent  Explanation 
Ontology  consisting  of  familiar  high-level  agent  concepts  to  be  used  for  specifying 
the  agents’  behaviors  as  background  knowledge  for  the  explanation-generation 
engine,  using  the  ontology  to  model  the  UAV  domain  to  enable  automated 
explanation  generation  of  technologies  applied  to  UAV  surveillance,  developed  a 
method  to  automate  some  of  comprehension  tasks  that  users  perfonn  to  understand 
agent-based  systems.  To  aid  in  building  the  background  knowledge,  a  heuristic-based 
algorithm  was  developed  to  suggest  possible  causal  relations  between  agent  concept. 

•  Developed  a  tool  called  Tracer  to  support  explanation-based  verification  methods 
and  performed  preliminary  analysis  and  verification  of  agent  behavior  in  Metron ’s 
UAV  simulator.  To  visualize  what  is  happening  as  the  agent-system  simulator 
executes,  the  Tracer  Tool  generates  causal  graphs  representing  agent  behaviors, 
constructed  from  observations  of  agent  beliefs,  goals,  intentions,  actions,  and 
interaction,  as  well  as  events  in  the  environment.  The  causal  graph  has  been 
demonstrated  on  two  planning  algorithms  used  in  Metron's  UAV  simulator.  The 
visualization  aids  in  quick  comprehension  of  the  agent  system,  which  brings  up 
insightful  questions  to  the  agent  designers  and  developers  about  why  the  agents  are 
behaving  in  a  certain  manner  or  why  a  particular  agent  performed  a  specific  action. 
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Populated  a  tool,  the  “Technology  Portfolio  Manager’’  (TPM)  with  specifications  of 
DARPA  TASK  agent  technology  to  aid  a  designer  in  deciding,  which  technologies 
from  DARPA  TASK  Agent  Technology  Repository  to  select  when  building  an  agent 
design,  depending  on  (1)  core  agent  competencies  such  as  planning,  sensing, 
modeling,  coordinating,  etc  offered  by  the  agent  technology,  (2)  infrastructure 
technological  requirements  and  (3)  ability  of  technology  to  deliver  specific  domain 
requirements  posed  by  the  UAV  surveillance  domain. 

Leveraged  the  Application  Architecture  Creation  Toolkit  (ACET)  to  aid  designers 
when  assessing  how  well  selected  technologies  from  DARPA  TASK  Agent  Technology 
Repository  can  be  reused  to  construct  an  agent-based  system  design.  ACET  helps  to 
evaluate  the  selected  against  operational  requirements  and  intended  architecture 
structure  with  tasks  and  agent  classes  specified  in  the  Agent  RA  and  evaluate  the 
Application  Architecture  with  respect  to  coupling  and  cohesion  matrices). 

Leveraged  the  Implementation  Architecture  Creation  Toolkit  (ICET)  to  aid  designers 
when  assessing  the  deployment  viability  of  selected  technologies  from  DARPA  TASK 
Agent  Technology  Repository.  The  designer  can  use  ICET  to  evaluate  not  only  the 
ability  of  agent  technologies  to  integrate  and  interoperate  with  one  another  but  also 
the  probability  that  these  agent  technologies  will  deploy  successfully  on  specified 
deployment  environments  (i.e.  specific  computational  platforms,  networks). 


4.2  Advancement  #2:  Core  Competency  Advances  and 
Experimentation  as  implemented  in  the  Sensible  Agent 
architecture 


The  research  contributed  advances  in  the  theory  and  application  of  specific  capabilities  that 
enable  a  system  of  agents  acting  as  distributed  decision-makers  to  (i)  organize  the  decision¬ 
making  and  information  sharing  connectivity  to  maximize  system  performance,  (ii)  assess  the 
trustworthiness  of  infonnation  by  detennining  the  level  of  information  uncertainty  and  reliability 
of  information  source  and  (iii)  plan  and  coordinate  efficiently  by  exchanging  their  preferences 
for  actions  under  varying  organizations  and  situations.  Specific  contributions  are  highlighted 
below: 

•  Defined  strategy  components  for  trusting  in  agent  social  networks.  Because  agents 
must  interact  with  other  agents  whose  motivations,  abilities,  and  strategies  change 
over  time,  the  researchers  have  developed  dynamic  strategies  by  which  an  agent  can 
determine  which  agents  to  interact  with  in  order  to  maximize  achievement  of  its  own 
goals.  Strategies  encompass  multiple  decisions  concerning:  1)  who  to  trust,  2)  how 
much  to  trust,  3)  toward  whom  to  behave  in  a  trustworthy  fashion,  and  4)  whom  to 
take  advantage  of. 

•  Implemented  experimentation  environment  for  observing  agent  trust  relationships 
and  comparing  trust  technologies.  The  researchers  played  a  key,  guiding  role  in 
constructing  the  Agent  Reputation  and  Trust  (ART)  Testbed  for  comparing  trust- 
related  technologies.  This  Testbed  is  currently  in  use  by  an  international  collection  of 
research  colleagues,  and  is  being  employed  to  compare  our  trust  strategies  against 
technologies  developed  by  other  researchers. 

•  Advanced  agent  technology  to  promote  efficient  and  effective  coordinated 
information  exchange  within  large  networks  of  information  providers.  Specifically, 
the  agents  evaluate  trustworthiness,  coverage,  relevance,  and  cost  of  information 
sources  and  search  for  the  most  appropriate  combination  of  information  sources. 
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•  Continued  efforts  to  advance  agent  technology  designed  to  improve  planning  and 
coordination  efficiency  by  exchanging  preferences  for  actions  under  varying 
organizations  and  situations: 

(1)  Devised  and  empirically  analyzed  options  for  value  propagation  in 
Markov  Decision  Processes  (MDPs).  Bounded-depth  value  propagation 
combined  with  value  estimation  (reward  combination  and  reward 
subsumption)  was  used  to  cast  the  MDP  computation  as  heuristic  search, 
yielding  an  eventually  optimal  anytime  solution.  MDPs  calculations  were 
adapted  for  situations  with  dynamic  tasks  through  Goal  Addition  and  Goal 
Removal  algorithms.  When  combining  these  accuracy  results  with  the 
observed  efficiency  advantages,  it  appears  as  though  the  efficiency  gained 
from  the  approximation  algorithms  may  well  be  worth  any  loss  in 
accuracy,  provided  some  errors  are  tolerable  in  the  respective  domain  (i.e., 
perfect  accuracy  is  not  critical). 

(2)  Enhanced  previously  developed  techniques  to  improve  the  efficiency  of 
action  selection  through  the  exchange  of  agent  intentions  and  preferences. 
Researchers  modified  the  Metron  UAV  simulator  to  include 
preference/commitment  sharing  functionality  and  conducted  experiments 
comparing  system  performance  (measured  as  average  time  between  task 
servicing  and  percentage  of  targets  visited  before  their  lifetime  expired) 
under  various  levels  of  situational  awareness  and  preference  sharing 
among  UAV  agents.  Four  coordination  techniques  based  on  passing 
increasing  amounts  of  information  were  compared,  No  Coordination, 
Location-based  Inference,  Communicated  Inference,  and  Explicit 
Partitioning.  Experimental  results  show  that  improving  situational 
awareness  through  increased  coordination  improves  combined  UAV 
performance. 
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4.3  Advancement  #3:  Application-related  Demonstrations  and 

Experimentations  to  evaluate  competency-based  MAS  designs  as 
well  as  specific  core  competencies. 


Key  military  domain  offered  real  world  challenges  to  drive  the  research  and  gauge  research 
progress.  Those  application  domains  are  listed  below. 

*  Demonstrated  DACAT  and  core  competencies  developed  in  Advancement  #2  for  two 
military  significant  domains:  (1)  Airlift  and  Transport  and  (2)  Unmanned  Aerial 
Vehicle  Surveillance  and  Reconnaissance. 

•  Engaged  in  significant  technology  transition  efforts  with  the  U.S.  Navy,  U.S.  Army, 
and  Texas  Department  of  Health  identifying  key  biosurveillance,  command-and- 
control  and  maritime  domain  awareness  applications  that  would  highlight  UT- Austin 
DARPA  TASK  research  advances. 
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5.0  Conclusions 


The  DARPA  TASK  program  and  this  affiliated  research  effort  offered  initial  steps  to 
advance  (1)  the  discipline  by  which  MAS  systems  are  design  and  evaluated  and  the  (2)  core 
competencies  which  define  the  sophisticated  behaviors  of  agents  to  self-organize  and  judge  the 
agents  they  elect  to  interact  with. 

This  research  project  utilized  a  combination  of  theory  and  experimentation  to  advance  both 
the  design  methods  and  delivered  functionality  of  Multi-Agent  systems  in  the  context  of 
military-relevant  problem  domains. 

Specific  toolkits  (DACAT,  Tracer,  ICET,  ACET)  were  developed  or  leveraged  and  thereby 
demonstrated  the  ability  to  formally  define,  compare  and  evaluate  agent  architectures  for 
multiple  military  applications.  The  verification  methods  used  by  Tracer  to  comprehend  real-time 
agent  behaviors  proved  useful  for  agent  architectures  independent  of  the  application  domain. 

In  terms  of  the  advancing  key  competencies  of  multi-agent  systems,  experiments  tested  new 
theories  about  how  systems  of  agents  acting  as  distributed  decision-makers  should:  (1) 
reorganize  by  allocating  decision-making  control  to  maximize  system  performance,  (2)  assess 
the  trustworthiness  of  information  by  determining  the  level  of  information  uncertainty  and 
reliability  of  information  source  and  (3)  coordinate  by  exchanging  their  preferences  for  actions 
under  varying  organizations  and  situations. 
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6.0  Recommendations 


This  research  team  recommends  defining  a  grand  challenge  problem  to  harvest  and  advance  the 
initial  seedling  research  explored  under  this  grant. 
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8.0  Acronyms 


ACET 

ART 

DACAT 

ICET 

KQML 

MAS 

MDP 

RA 

TPM 


-  Application  Architecture  Creation  Toolkit 

-  Agent  Reputation  and  Trust 

-  Designer’s  gent  Creation  and  Analysis  Toolkit 

-  Implementation  Architecture  Creation  Toolkit 

-  Knowledge  Query  and  Manipulation  Language 

-  Multi-  Agent  System 

-  Markov  decision  Processes 

-  Reference  Architecture 

-  Technology  Portfolio  Manager 
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